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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
6/21/2006 has been entered. 

Response to Amendment 

2. The present Office action is made in response to the amendment filed on 
6/21/2006. It is noted that in the amendment, applicant has amended claim 1 and added 
two new claims, i.e., claims 21-22, into the application. The pending claims are claims 
1-9 and 21-22 and these claims are examined in this Office action. Note that claims 
10-20 were canceled by applicant in the amendment of 

Claim Rejections - 35 USC § 103 

3. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

4. Claims 1-7 and 9 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Morita (Japanese reference No. 10-333047 A, of record) in view of Fantone et al 
(U.S. Patent No. 4,786,154, of record). 

Morita discloses an operating microscope comprising an image projecting optical 
system for producing images derived from an endoscope optical system which is 
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provided separate from the operating microscope, into an eyepiece optical 
system of the operating microscope so that the operating microscope image and 
the endoscope image can be simultaneously observed. Morita also discloses the 
use of at least one other optical display system for providing other images related 
to the object which images of the other display system are projected into the field 
of view of the operating microscope wherein the operating microscope image, the 
endoscope image and the image provided by the other display system are 
different from each other. 

In particular, in the embodiment described in columns 20-21 and shown in figures 
27A-27B, the operating microscope comprises an observation optical system 
(49) for forming an optical image of an object including an affected region and an 
observation means (48, 153) for observing the operating microscope image (152) 
in a field of view of the observational optical system. The first display means 
comprises an endoscope (37) with a camera, a camera adapter (43), a camera 
control unit (43) for displaying images of an object in the operation part (51) in a 
liquid crystal display (148) via an image processing unit (145). The other display 
systems for observably displaying other images are in the form of a waveform 
monitor (146) and CT system (147) wherein the images provided by the monitor 
(146) and/or CT system (147) are projected into the liquid crystal element (148) 
via the same image processing unit (145). Regarding to the images 
superimposing on the operating microscope image, in columns 20-21 , Morita 
discloses that the images provided by the endoscope, the waveform monitor and 
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the CT system are superimposed onto the operating microscope images and the 
sizes and contents of the operating microscope image (152), the endoscope 
image (155) and the waveform image (156) or the CT image (157) are different 
from the others. 

Regarding to the feature that whether the second image is displayed is 
selectable by an operator as recited on the newly-added material on last two 
lines of claim 1, it is noted that it would have been obvious to one skilled in the 
art that an operator operates the operating microscope provided by Morita will 
control the image processing unit to select the number of images/information 
superimposed with the observing the operating microscope image (152) in a field 
of view of the observational optical system. In other words, if the operator does 
not wish to review the images provided by either the endoscope (37) or the 
images provided by the waveform monitor (146) or the images provided by the 
computed tomography system (147) then (s)he just control the image processing 
unit to block or stop the transmission of such a selectively image to the 
microscope image (152) in the field of view of the observation optical system. 
Regarding to the feature related to a computer for controlling the size of the 
image provided by the endoscope, it is noted that the use of a camera control 
unit (41) for controlling the image provided by the endoscope (37) to the image 
processing unit (145) is inherently capable to vary the size of the image 
dependent upon the magnification of the optical microscope. The support for that 
conclusion is found in the other embodiments provided by Morita when he 
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discloses the combination of an operating microscope and an endoscope which 
image of the endoscope is large in comparison to the operation microscope 
image (see the embodiment shown in figure 12). The size of the endoscope 
image as shown in the embodiment of the figure 27A in comparison to the 
endoscope image as shown in the embodiment of figure 12 is an evidence to 
show that the size of the endoscope image is able to vary by the operation of the 
camera control unit (41) and the image processing unit (145). 
Regarding to the feature that the second image in the form of a marker image, 
such feature is also considered as an inherent feature from the images 
superimposed into the operating microscope image provided by either the 
waveform monitor (146) or the CT system (147) absent the specific structure of 
the so-called "marker image" recited in the present claim. For instance, the CT 
images can include a graph with scales or any medical symbols related to the 
object to be operated/observed to provide more information related to the object 
to the observer. 

The only feature missing from the system provided by Morita is that he does not 
clearly disclose the use of two display systems and two optical systems wherein 
each display system is on the optical axis of the correspond optical system so 
that the correlation of display positions of the first and second images are 
maintained as claimed in the newly-added material added to the present claim 1 . 
However, the use of two systems each comprises a display and an optical 
system wherein the display is arranged on the optical axis of the optical system is 
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known to one skilled in the art as can be seen in the microscope provided by 
Fantone et al. In particular, Fantone et al disclose a microscope having an 
observation system for forming an image of an object and two systems each 
comprises a display (42) and an optical system (44) wherein the display (42) is 
arranged on the optical axis of the optical system (44). See column 4 and fig. 2. 
Thus, it would have been obvious to one skilled in the art at the time the 
invention was made to modify the system provided by Morita by using two 
systems each comprises a display and its own optical system for the purpose of 
providing images which images are projected/imposed onto the image in the field 
of view of the observation system as suggested by Fantone et al for the purpose 
of correlation of the displayed positions in the image in the field of view of the 
observation system. 

5. Claim 8 is rejected under 35 U.S.C. 103(a) as being unpatentable over Morita in 
view of Fantone et al as applied to claim 1 and further in view of Truppe (of record) 
The operating microscope comprising an image projecting optical system for 
producing images derived from an observation optical system of the microscope, 
an endoscope optical system and two optical display system for providing 
images related to the object which images can be simultaneously observed as 
provided by Morita and Fantone et al meet all of the features recited in claim 8 
except that it does not clearly state the first image provided by the endoscope 
includes image indicative of position of the endoscope. However, the use of an 
endoscope having a position camera attached thereto for providing information 
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related to the position of the endoscope and for projecting the information onto 
the visual field of the image provided by the endoscope is disclosed in the art as 
can be seen in the system provided by Truppe. See columns 5-6. Thus, it would 
have been obvious to one skilled in the art at the time the invention was made to 
modify the system as provided by Morita and Fantone et al by using an 
endoscope having a camera with a position sensor as suggested by Truppe for 
the purpose of providing position data of the endoscope in the visual field of the 
operator. 

6. Claim 22 is rejected under 35 U.S.C. 103(a) as being unpatentable over Morita in 
view of Fantone et al as applied to claim 1 above, and further in view of Goto et al (U.S. 
Patent No. 5,883,933). 

The operating microscope comprising an image projecting optical system for 
producing images derived from an observation optical system of the microscope, 
an endoscope optical system and two optical display system for providing 
images related to the object which images can be simultaneously observed as 
provided by Morita and Fantone et al meet all of the features recited in claim 22 
except that it does not clearly state the second image provided by the computed 
tomography system (147) is a three-dimensional image. However, it is known to 
one skilled in the art that a three-dimensional configuration a computed 
tomographic image is able to build on the basis of arrangement/stack of slices of 
computed tomographic images. An example of an apparatus for forming and 
displaying a three-dimensional image from computed tomographic images is 
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provided by Goto et al. See columns 1-2. Thus, it would have been obvious to 
one skilled in the art at the time the invention was made to modify the combined 
product provided by Morita and Fantone et al by using a computed tomography 
system for providing three-dimensional images as suggested by Goto et al for the 
purpose of displaying the three-dimensional images onto the field of view of the 
observation system. 

7. Claims 1-7, 9 and 21 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Morita (Japanese reference No. 10-333047 A, of record) in view of Tsumanuma et 
al (U.S. Patent No. 5,742,429, of record). 

Morita discloses an operating microscope comprising an image projecting optical 
system for producing images derived from an endoscope optical system which is 
provided separate from the operating microscope, into an eyepiece optical 
system of the operating microscope so that the operating microscope image and 
the endoscope image can be simultaneously observed. Morita also discloses the 
use of at least one other optical display system for providing other images related 
to the object which images of the other display system are projected into the field 
of view of the operating microscope wherein the operating microscope image, the 
endoscope image and the image provided by the other display system are 
different from each other. 

In particular, in the embodiment described in columns 20-21 and shown in figures 
27A-27B, the operating microscope comprises an observation optical system 
(49) for forming an optical image of an object including an affected region and an 
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observation means (48, 153) for observing the operating microscope image (152) 
in a field of view of the observational optical system. The first display means 
comprises an endoscope (37) with a camera, a camera adapter (43), a camera 
control unit (43) for displaying images of an object in the operation part (51) in a 
liquid crystal display (148) via an image processing unit (145). The other display 
systems for observably displaying other images are in the form of a waveform 
monitor (146) and CT system (147) wherein the images provided by the monitor 
(146) and/or CT system (147) are projected into the liquid crystal element (148) 
via the same image processing unit (145). Regarding to the images 
superimposing on the operating microscope image, in columns 20-21 , Morita 
discloses that the images provided by the endoscope, the waveform monitor and 
the CT system are superimposed onto the operating microscope images and the 
sizes and contents of the operating microscope image (152), the endoscope 
image (155) and the waveform image (156) or the CT image (157) are different 
from the others. 

Regarding to the feature that whether the second image is displayed is 
selectable by an operator as recited on the newly-added material on last two 
lines of claim 1 , it is noted that it would have been obvious to one skilled in the 
art that an operator operates the operating microscope provided by Morita will 
control the image processing unit to select the number of images/information 
superimposed with the observing the operating microscope image (152) in a field 
of view of the observational optical system. In other words, if the operator does 
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not wish to review the images provided by either the endoscope (37) or the 
images provided by the waveform monitor (146) or the images provided by the 
computed tomography system (147) then (s)he just control the image processing 
unit to block or stop the transmission of such a selectively image to the 
microscope image (152) in the field of view of the observation optical system. 
Regarding to the feature related to a computer for controlling the size of the 
image provided by the endoscope, it is noted that the use of a camera control 
unit (41) for controlling the image provided by the endoscope (37) to the image 
processing unit (145) is inherently capable to vary the size of the image 
dependent upon the magnification of the optical microscope. The support for that 
conclusion is found in the other embodiments provided by Morita when he 
discloses the combination of an operating microscope and an endoscope which 
image of the endoscope is large in comparison to the operation microscope 
image (see the embodiment shown in figure 12). The size of the endoscope 
image as shown in the embodiment of the figure 27A in comparison to the 
endoscope image as shown in the embodiment of figure 12 is an evidence to 
show that the size of the endoscope image is able to vary by the operation of the 
camera control unit (41) and the image processing unit (145). 
Regarding to the feature that the second image in the form of a marker image, 
such feature is also considered as an inherent feature from the images 
superimposed into the operating microscope image provided by either the 
waveform monitor (146) or the CT system (147) absent the specific structure of 
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the so-called "marker image" recited in the present claim. For instance, the CT 
images can include a graph with scales or any medical symbols related to the 
object to be operated/observed to provide more information related to the object 
to the observer. 

The only feature missing from the system provided by Morita is that he does not 
clearly disclose the use of two display systems and two optical systems wherein 
each display system is on the optical axis of the correspond optical system so 
that the correlation of display positions of the first and second images are 
maintained as claimed in the newly-added material added to the present claim 1 . 
However, the use of two systems each comprises an optical apparatus for 
transmitting light from a particular area of an object and an optical system for 
superimposing the image of the object into a field of view of an user using an 
observation system wherein the optical apparatus is arranged on the optical axis 
of the optical system is known to one skilled in the art as can be seen in the 
microscope provided by Tsumanuma et al. In particular, Tsumanuma et al 
disclose a microscope having an observation system (12) for forming an image of 
an object and two systems each comprises an optical apparatus (17r or 171) and 
an optical system ((18, 14a, 15r) or (18, 14a, 151)) wherein the optical apparatus 
is arranged on the optical axis of the optical system. See columns 6-7 and fig. 3. 
Regarding to the feature related to the third optical system includes a movable 
mirror as recited in newly-added claim 21 , such a feature is not critical to the 
invention because the specification has disclosed that the third optical system 
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comprises a projection optical system which is not movable. The feature related 
to the third optical system in the form of a projection optical system is indeed 
claimed as can be seen in the present claim 5. Further, it is noted that the mirrors 
(15r or 151) are able to rotate to either allow the light from the apparatus to be 
feed into the field of view or to block/prevent the image provided by the optical 
apparatus from enter onto the field of view. See column 6, lines 26+. Thus, it 
would have been obvious to one skilled in the art at the time the invention was 
made to modify the system provided by Morita by using two systems each 
comprises an optical apparatus and its own optical system for the purpose of 
providing images which images are projected/imposed onto the image in the field 
of view of the observation system as suggested by Tsumanuma et al for the 
purpose of correlation of the displayed positions in the image in the field of view 
of the observation system. 
8. Claim 8 is rejected under 35 U.S.C. 1 03(a) as being unpatentable over Morita in 
view of Tsumanuma et al as applied to claim 1 and further in view of Truppe (of record) 
The operating microscope comprising an image projecting optical system for 
producing images derived from an observation optical system of the microscope, 
an endoscope optical system and two optical display system for providing 
images related to the object which images can be simultaneously observed as 
provided by Morita and Fantone et al meet all of the features recited in claim 8 
except that it does not clearly state the first image provided by the endoscope 
includes image indicative of position of the endoscope. However, the use of an 
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endoscope having a position camera attached thereto for providing information 
related to the position of the endoscope and for projecting the information onto 
the visual field of the image provided by the endoscope is disclosed in the art as 
can be seen in the system provided by Truppe. See columns 5-6. Thus, it would 
have been obvious to one skilled in the art at the time the invention was made to 
modify the system as provided by Morita and Fantone et al by using an 
endoscope having a camera with a position sensor as suggested by Truppe for 
the purpose of providing position data of the endoscope in the visual field of the 
operator. 

9. Claim 22 is rejected under 35 U.S.C. 103(a) as being unpatentable over Morita in 
view of Tsumanuma et al as applied to claim 1 above, and further in view of Goto et al 
(U.S. Patent No. 5,883,933). 

The operating microscope comprising an image projecting optical system for 
producing images derived from an observation optical system of the microscope, 
an endoscope optical system and two optical display system for providing 
images related to the object which images can be simultaneously observed as 
provided by Morita and Tsumanuma et al meet all of the features recited in claim 
22 except that it does not clearly state the second image provided by the 
computed tomography system (147) is a three-dimensional image. However, it is 
known to one skilled in the art that a three-dimensional configuration a computed 
tomographic image is able to build on the basis of arrangement/stack of slices of 
computed tomographic images. An example of an apparatus for forming and 
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displaying a three-dimensional image from computed tomographic images is 
provided by Goto et al. See columns 1-2. Thus, it would have been obvious to 
one skilled in the art at the time the invention was made to modify the combined 
product provided by Morita and Tsumanuma et al by using a computed 
tomography system for providing three-dimensional images as suggested by 
Goto et al for the purpose of displaying the three-dimensional images onto the 
field of view of the observation system. 

Response to Arguments 

10. Applicant's arguments with respect to claims 1-9 have been considered but are 
moot in view of the new ground(s) of rejection. 

Conclusion 

1 1 . Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Thong Q. Nguyen whose telephone number is (571) 
272-2316. The examiner can normally be reached on M-F. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Drew A. Dunn can be reached on (571) 272-2312. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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Primary Examiner 
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